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1 Introduction 

In our previous paper jR.Sj we have proven the Poisson Hypothesis (PH) for 
some simple models of information networks. In a nutshell, PH states that 
under general conditions a large network relaxes to a stationary state, in 
which different nodes are almost independent, while the relaxation time does 
not depend on the size of the network, provided its initial state is properly 
chosen. Moreover in this stationary state the incoming flow to every node is 
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approximately Poissonian with a constant rate, no matter what the service 
times are. 

The present paper is devoted to the cases of violations of the Poisson 
Hypothesis. Our goal is to give examples when the relaxation time for the 
network diverges with its size, for certain initial conditions, v. Informally 
speaking, our result means that for certain service time distributions the 
network can behave in unstable and unpredictable manner. More precisely, 
we know from |RSj that if the expected service time S (u) (see below) of the 
initial state v is finite, then PH holds. However there exist dangerous states, 
with infinite expected service time S (v), and they may cause the system to 
behave irregularly. This phenomenon can be interpreted as the appearance 
of the phase transition in the network. 

We will give now the heuristic description of how such an instability 
can occur. To be able to construct such an example we need the following 
property of the distribution of the service time 77. Supposing that for every 
r > the probability that rj > r is positive, we introduce the remaining 
service times 



In what follows we will suppose that the function R v (r) is unbounded; 

otherwise 



is always finite and PH holds for every initial state, as was proven in [RS . 
Let A be the (big) set of the nodes of our network. We will consider the closed 
network - i.e. customers C are not leaving the network, and new ones do not 
come. After being served the customer goes to some other node and waits 
for his turn there (see F. Kafka, Das Schloss). The number of customers, 
N = \C\ , will be proportional to the number M = \A\ of servers, N = pM. 
The service times at different servers are i.i.d. random variables, with the 
distribution rj. Such a model is often used, for example, in the studies of 
multiprocessor computer systems, |BSj . |HVj . Suppose for definiteness that 
R v (0) = E (77) = lsec. Imagine that the initial state of the network at 
t = is such that on a tiny subset A% C A of servers there are customers C\ 
already under service, \C\\ = \A± \ , and moreover their service lasts already 
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rj — t rj > r I , r > 



and consider the expected values 




S(u)=E u (R v (t)) 
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a time T\ > lmin. If R v (1mm) is large enough, then it can well happen 
that almost all the other customers in the system, C\C V eventually, after 
time T{ n will find themselves queuing for the servers in Ai, and the system 
will be blocked for a while. Yet after some longer time T° ut the service of 
the blocking clients C\ will be over, they leave their nodes, and after still 
later moment Tf™ the queues at A\ dissolve and network is back to normal, 
having on the average p clients per server. However, suppose now more: 
that on a tiny subset A2 C Ai at initial moment t = the corresponding 
set C2 C C\ of the customers is in fact served already for a much longer 
time T2 > Ihour, while R v (lhour) is even larger. Then the behavior of 
the network during the time [Tf n ,T? ut ] and [T° ut , T-f"] will largely remain 
the same as above, while after a still later moment T™ essentially all the 
customers will be queuing for the servers in Ai- The network again will be 
blocked during the time interval [T^jT™*] , with essentially all the servers 
idle, after which the second recovery period, [T 2 OM *,T 2 6n ] , starts, and after the 
moment Tf™ we have 'busyness as usual' picture, with p clients per node on 
the average. Clearly, this construction can be iterated, and the number of 
iterations is bounded only by the size of the network, \A\ . The period of this 
oscillatory behavior increases with time. 

A similar kind of behavior occurs in other contexts. One such example is 
the phenomenon of aging, see e.g. (BDG| . 

In this paper we will construct examples of the networks with the above 
behavior. Not surprisingly, it turns out to be quite involved technically. The 
reason is that the synchronization which we want the system to have, can be 
destroyed by fluctuations. Indeed, the long queues, which we want to appear 
at the nodes A\,Az... can be supplemented by other long queues appearing 
randomly elsewhere, which will interfere with the behavior we want. Also, 
the moments T° ut of the beginning of the queues to dissolve, are not well 
defined and are in fact not the moments, but segments of time, their duration 
growing with i. Therefore the whole picture desired can be smoothed away 
in a while. 

This is why in the present work we will treat the simplest case of the 
above behavior, when the service time 77 assumes only integer values. This 
simplification, however, comes with its own cost. The present paper relies 
much on our first one, |RSj . which deals only with continuous random vari- 
ables 77, using even the smoothness properties of the density p, as well as 
its positiveness everywhere. Therefore our work consists of two parts. In 
the first one we construct examples of networks and initial states with the 
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desired behavior, assuming the validity of the results of [RSJ for the case of 
integer valued service times. In the two Appendices we present the extension 
of |RSj to the integer valued case. 

The rest of the paper is organized as follows. In the next section we give 
the definition of the non-linear Markov process, the study of which estab- 
lishes the validity of properties described above. In Section 3 we introduce 
coordinates in one class of these processes. The next section contains the 
formulation of our main result and its three subsections present the proof of 
it. 

Dynamical systems aspect. In this paragraph we describe the specific 
features of the corresponding dynamical system. As we were explaining in 
|RSj , the validity of PH was to some extent a corollary of the statement that 
the dynamical system D v , corresponding to the Non-linear Markov Process, 
has a global attractor. More precisely, if the function R n is bounded, then D n 
has a line I of fixed points, and any other point in the phase space is driven 
by dynamics to the corresponding point in £, which has the same value of 
the conserved quantity, N. The results of the present paper give an example 
of another feature of D v . Namely, for some service times 77, with the function 
Rrj unbounded, the union of the basins of attraction of fixed points of the 
line £ is not the whole phase space. Moreover, for some initial points outside 
this union the corresponding trajectory 7 (t) behaves as follows: as t — > 00, 
the distance dist (7 (t) , £) — > - and yet the line 7 (t) has no limit as t — > 00, 
and the set of its limit points is a non-trivial segment of the curve £. So in 
some sense the trajectory 7 (£) behaves like the graph of the function sin -, 
as x — > 0. Such behavior of dynamical system is called eternal transience, see 

m. 

2 Model description 

Consider the closed network of M servers and iV clients, described briefly 
in the previous section. Its detailed description is given in the Appendix I. 
For large M, N this is a complicated Markov process; but the Weak Poisson 
Hypothesis predicts that in the limit -jg — > p it splits into product of inde- 
pendent random processes, going on different servers. We prove the Weak 
Poisson Hypothesis for our setting in the Appendix I, while here we will de- 
scribe the limiting processes going on single servers. They turn out to be 
Non-linear Markov Processes (NML). 
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The corresponding dynamical system, describing the evolution of the state 
ji of a single server, A/", is determined by one random variable, 77 - service 
time - whose distribution is given by the probabilities 



p (k) = Pr {rj = k} , 



with 



oo 



5>(fc) = l. 



k=l 



In our application most of p (k) will be zero, but infinitely many of them will 
stay positive. 

The dynamical system is defined on the space of probability measures \i 
on the set ft = {co = (n, r) : n = 1, 2, r = 0, 1, 2, ...} U (0, 0) , so ft C Z 2 . 
We will denote by the special point (0, 0) . The notation n (u) , r (o>) mean 
the first, resp., second coordinate of Therefore the measure /x is a collection 
of non-negative numbers fi (n, r) , with 



Let the measure /i T on the T-th step is given. We will describe now 
the way it evolves in one time-step to the measure fx T+l . This goes in three 
stages. 

A. Vertical shift. 

We construct the measure <p T+1 by 



/i (n, t) + // (0) = 1. 



n=l,r=0 




f /x T (n,r-l) ifr>0 
= \ for r = 

(0) = ^ (0) . 



(1) 



B. Downward jump. (Exit flow) 

We introduce the conditional probabilities p T by 



p(r) 



(2) 



J2k>rP( k )' 



We define the measure ip T+1 by 



f 4> T+1 M {i - p T ) 

{ r+1 (o) + E r>1 T+1 (i^)K 



if t > 1, 

if n > 1, r = 

if n — t — 0. 



0, 



(3) 
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C. Right-shift. (Inflow) 

Let 7T\ (k) be the distribution of the Poisson random variable; 

7T X (k) = e-^. (4) 

We will interpret the function irx (k) as a measure on Z 1 C Z 2 , supported 
by the points (A;, 0) . Likewise, we think about all the measures introduced 
above, as measures on Z 2 . Let 

A(T + l) = ]T][> T+ >,T)p r (5) 

n>l r>l 

be the total mass which went down (to the level r = 0, see (JHJ)) on the 
previous step. Note for the future that 

A(T+1)<1. (6) 

We put finally 

/i T+1 (n, r) = [V T+1 * 7r A(T+1) ] (ti, r) = ^ ^ T+1 (n - fe, r) vr A(T+1) (fc) . (7) 

k 

Particle conservation property. Note that by construction the mean 
value 

wen 

does not change with T. 

3 Choice of the distribution of 77 and of the 
initial state v 

Let A = {cii = 1 < ci2 < < ...} C NU {00} be an infinite subset. Then the 
probabilities p (k) will be chosen to vanish unless k = a>i for some i. 
The probabilities p (a„) are given by 



P{a n ) = 

On <i<a n +l 
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We denote the conditional probabilities p an by q n ; 

p(a n ) 
J2 k >a n P( k )' 

We want the conditional probabilities q n to increase to 1 very fast. This can 
be ensured by taking the set A very sparse. 

In what follows we will use the convention that both relations: oo < oo 
and oo < oo - are valid. 

We parametrize the sets A in the following way. Let the integers Co = 
< B 1 = 1 < Ci < B 2 < C 2 < ••• < oo be given. We say that the set A is of 
type B = {B 1 , Ci, B 2 , C 2 , ...} , if A C {U^ x [B k , C k ]} , and each intersection 
AD[B k ,C k }^0. 

By definition, the initial state v will be supported by the set 

V = {(n,T):l<n<n,reUlt [C k , C k + F k+l }} C Q, (9) 

where n > 1 is fixed, as well as the integers F 1 = < F k < oo . We will 
assume that C k + F k+ i < B k+ i for all k > 0. We further assume that the 
differences G k = C k — B k > will be finite and fixed. It will be convenient 
for us to parametrize the family of u-s we will consider as follows. For every 
k > let us fix in an arbitrary way a probability measure x k on the finite 
set {(n, r) : 1 < n < n, r G [C k , C k + F k+ i]} . (For example, we can take all 
H k to be 5-measures having a unit atom at the point (1, C k ) .) Now for every 
collection 

A = {4>0}, ^ 4 = 1 

fc:_Bfc<oo 

we define the probability measure z/a on Q by 

v A = ^2d k K k . (10) 

k 

In what follows, the choice of the integer n, integers F k , integers G k = C k — B k 
and the measures x k will be fixed. It will be the choice of the parameters 
B k and A that we will have to make. We will define them inductively. This 
will be possible in our case because by construction which follows, for every 
time duration T, however large, the relevant features of our dynamical system 
will depend only on the first few values B k ,d k , k < k (T) ; though of course 
k (T) — > oo as T — > oo. 
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In the following we will need that the distances B k+1 — (C% + F k+ x) grow 
fast enough. Namely, we will need that for all k 

Bk+i — (C k + Fk+x) > B k . (11) 

We will denote the server thus constructed, with the initial state specified, 
as M (B, A) . To formulate our main result we need to introduce the mean 
service time E — E (rj) (which is a function of B) and the average number of 
clients p = N (z/a) • 



4 The main result 

Theorem 1 There exists a choice of the parameters B and A, such that the 
corresponding input rate function Xb,a {t) (= output rate function), see (pj) - 
has no limit as t — > oo. Moreover, given e > 0, there exists a choice of B, A 
such that 

• there exists a sequence of disjoint segments of time moments, t G 
[Tf ,Tr'] , lim^oolf {out) -> oo, where X BA (t) < e. 

• there exists an increasing sequence of time moments T k n oo, such 
that 

\BA(T b k n )>cPK(v,p)~e, (12) 
where the rate cpk (ViP) > zs given by Pollaczek-Khinchin relation. 
As a result, the state /J has no limit as t — > oo. 

The main idea of studying the evolution of the server Af (B, A) is to treat 

it as a small perturbation of the servers Af n having the form Af \ B m A n J , 

where the sequence B n = {Bx, Cx, B2, C2, ...} has the first 2n entries the 
same as in £>, while B k = 00 once k > n. The sequence A n has the first n — 1 
coordinates being the same as in A, the n-th one is equal to J2 k>n d k , and 
the rest of them are zeroes. The corresponding service time r\ k thus assumes 
only finitely many values, and the vector A n has at most n non-zero entries. 

Of course, the evolution of Af (B, A) can be close to the one of Af {b u , Anj 

only for finite duration of time, and for longer times we will need to go to 
a finer approximation, with bigger value of the cutoff n. We will define the 
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parameters B n ,A n by induction, their definitions being a function of the 
dynamics of the servers with the lower cutoffs. 
We will use the following notation: 

tya,6] = {uj = (n.r) : a < r < b} . (13) 

In particular, fl k = = (n, t) : t = k} . We put 

N k (fi)^j2 n (*) ( w ) ' ( 14 ) 

iV[a,6] (M) = XI 71 W V W ■ ( 15 ) 



a.b] 



4.1 The first step of induction 

On the first step we will compare the server Af (B, A) with the server jVi = 
J\f \ Bi, AiJ . B\ is just the pair \B\ = 1, Ci} , the service time r]i takes (in- 
teger) values in the segment [l,Ci] , (taking value 1 with the probability at 
least ~, see (JHJ)), and the initial state is the measure xi, supported by the 
segment {(n, 0) : 1 < n < n} . The sequence A^ has one non-zero component, 
di, which equals to 1. The result of this comparison will allow us to determine 
the values of the parameters B 2 and d\ - and therefore C 2 - of the server 
M(B,A). 

The evolution fij (see di}-©) of our server with the service times © 
and initial state (fTU|) . is relatively simple. 

For the benefit of the reader let us describe the server jVi = N \ B\, Ai^ in a 

special case when C\ = B\ = 1. We denote it by M^- Then the service time 17 is 
non-random: rj = 1 with probability one. All the measures fif are supported by 
{0} U N. The initial state is the measure x\. Denote by p\ = E (x\) ■ Let f^J 
be the measure after T steps. Let us write it as 

£ = c(T)5 + (l-c(T))a T , 

where 5q is an unit atom at 0, while a T has support in N. Then we have 

ij T+1 (n, 0) = c (T) S (n) + (1 - c (T)) a T (n + 1) (16) 

(see ©), 

A(T+l) = a T (N) (17) 
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(see (jnj)), and finally 

^ +1 = ^ T+1 *^(T + i) (18) 

(see ©). 

Another way of describing it is the following: let £ T be the integer random 
variable, having distribution pj . Define 



e-l if£ T >0. 



Then = C T + 7 T+1 i where j T+1 is the Poisson random variable, independent 
of ^ T , with the distribution 7Tp r {£T>o}- The conservation law E = E = 
pi is immediate. 

The Poisson Hypothesis for the server ]\f\ = Af \B\, A^j implies the 

weak convergence: p\ — > v^ 1 as T — > oo, where z/f 1 is the unique measure 
on f2[ 0j Ci-i]) which is invariant under the above dynamics and which satisfies 
N (z/f 1 ) = N (xi) = pi. The rate function \ Bi ^ (t) goes to the limit value, 
A Si £ • The PH validity follows from |RSj and the Appendix of the present 
paper. 

In the special case of the server A/^* the Poisson Hypothesis was obtained earlier 
in [Sj. The limiting value Ai of the rate function Ai (T) as T — > oo in that case 
equals to z/f (N) = 1 — z/f (0) . 

The convergence p{ — *> z/f 1 can be expressed in words: "the measures pf 
become very close to the measure z/f 1 ", if we will use the term "very close to 
z/f 1 " to mean the following. Denote by Ii C f2[o,Ci-i] the sma hest rectangle 
of the type {u = (n,r) : n < m, r G [0, G\ — 1]}, having the property 

iV(zzf)- £ ni ^(„, r )<-L. (19) 

(n,r)e/i 

We say that /i is e-close to z/f 1 iff for every w G Ii we have 

u (u>) zyf 1 (a;) 

1 -e < p.\ \ < 1 + e, 1-e < 1 / / < 1 + e. 

In the following the number e > will be some small fixed quantity. We 
define now the time T\ n as the first moment T when the measure pj becomes 
£-close to zvf 1 . 



10 



Note now that if I C fWci-i] * s some finite rectangle, and T is some finite 



time moment, then the restriction \x 



r 



of the state of the server Af (£>, A) 



depends on the parameters B = {Bi, C±, B 2 , C 2 , ■ ■■} , A = {dk > 0} of the 
server Af continuously. We will apply this continuity at the point £>i, Ai. We 
can then claim that there exist a value B 2 < 00 and a value di < 1 such that 
for any consistent choice of the sets B and A of the parameters B 2 < B 3 < ... 
and di, d 2 , ... : d k > 0, d fc = 1, satisfying 

B 2 > B 2 and 1 > d x > d u (20) 

the state /i T i n of the corresponding server Af (B, A) is 2e-close to z/f 1 . That 
means in particular that any such server at the moment Tf™ has the property 
that its input rate A^a (rf n ) differs very little from the rate X Bi Ai (T-f 71 ) , 
which in turn is close to its limiting value A B A . In the following we will as- 
sume the relation (j2U|) to be valid for all servers Af (B, A) further considered. 

The choice of the value of the parameter di G A can now be made: we 
can take it to be equal to d\. However we have to work more to be able to 
choose B 2 > B 2 . 

To do this we will look on the quantities 

N[ 0lCl -i] 0) = Yl n ( w ) ^ ( w ) ' 

LJ ^[Q,C 1 -1] 

where f2[ 0j Ci-i] = {(^, t) : r G [0, C\ — 1]} , see (JT^J) . Clearly, the value N^d-i] 
does not depend on T, since N[ Cl -i] (^J) = N (/xf) , while the latter is con- 
served quantity. The quantity iV (/x T ) , corresponding to the server Af (£>, A) , 
is also conserved, but not the A^[ 0j d-i] (ff r ) ] moreover, we are going to show 
that for every e > we can find the time duration T = T (e) , such that 
if B 2 > T then the function iV^d-i] (A 4 *) decays with t for 1 < t < T and 
becomes less than e at t — T {e) . We start with a simple computation. 

Let /i be a positive measure on {0} U N, with \i ({0} U N) = 1 — 5, 5 > 0. 
Let a be a positive measure on N, such that a < fi; here it means that for 
every k > a(k) < fi(k) . Denote by m the value a (N) . Define Ji by 

77 /„\ _ / A« (n) - a (n) + a (n + 1) if n > 0, 
^ l J \ /i(0) + a(l) if n = 0. 

Finally, let 7r m be a probability measure on {0} U N, with E (7r m ) = m, and 
we define = Ji * rr m (compare with the dynamics (|lb| ) -()18| ) ). 
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Lemma 2 



N (fj) - N = mS. 



(21) 



Note that if \x is itself a probability measure, then 5 = and under the 
above transformation the mean value N (/i) is conserved, as it should be. 
Proof. The proof consists of a straightforward computation. 

N (^ +1 ) =N (fL*n m ) = (l-5)E 
= No (ft) + (1 - 5) m. 

Therefore 

N (/x) - No = iV (//) - iV (//) - (1 - 5) m 
= ^2ka(k) ka (k + l)-(l-S)m 

k>l k>l 

= ^2 hot (k) - ^2 {k + l)a{k + 1) + ^ a(k + 1) — (1 — 5)m 

k>l k>l k>l 

= <y (k) — (1 — 5) m = 5m. 

k>l 

■ 

Applying the above Lemma to the evolution // of the server M (£>, A) we 
have that for any t < B 2 — (C\ + E 2 ) 

No (//) - No > (l - dx) A (B)A) (t) . 

Here we have the inequality, rather than equality of (|21|). because, in fact, 
once B 2 < 00, the measure (f^d-i]) decays with t, and so fJ (f2[o,Ci-i]) < 
/i* =0 (fi[o,Ci-i]) = ^i- Note that the applicability of the Lemma is based on re- 
lation (jllj) . Since the total mean number of customers, N (//*) , is a conserved 
quantity, that can happen only if the rate X(b,a) (*) takes arbitrarily small 
values for arbitrarily large t-s (not exceeding the threshold B 2 — (C% + E 2 )). 
We now choose the value B 2 as the one satisfying: 

1. 5 2 > B 2 , 

2. 5 2 - (d + £ 2 ) > Tf\ 
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3. there exists a time moment t G 



T^,B 2 -(C 1 + E 2 ) 



for which the 



rate X(b,a) (*) < £ - (That moment might depend on the parameters 
B, A; they have however to be consistent with all the choices already 
made.) 



Since all the restrictions on B 2 are the lower bounds, its choice is possible. 
The time moment T™ is defined to be the above moment of low input rate. 
We define T° ut = B 2 - (d + E 2 ) . 



4.2 The second induction step 

In this section we will determine the values of the parameters B3 and d 2 of the 

server M (£>, A) . We will do this by looking on the server J\f 2 = M (b 2 , A 2 J . 

B 2 is the set {Bi = 1,C\, B 2 , C 2 } , the service time r\ 2 takes (integer) values in 
[1, Ci] U [B 2 , C 2 ) (taking value 1 with the probability at least |, see (JHJ)). The 
value C 2 equals to B 2 + G 2 , where the parameter G 2 was fixed earlier. The 
sequence A2 has two non-zero entries: A 2 = (di, 1 — d\) . The initial state is 
given by the measure , see (II Oj) . The values B 2 and d\ were chosen earlier. 

The server J\f (b 2 ,A 2 \ thus belongs to the class of servers J\f(B,A) , 
considered in the previous section, so all the results of it apply. In particular, 
the rate function A s £ 2 nas the properties that A Ba ^ 2 (Tf n j m A Bl ^ , while 
Ab 2 ,a 2 ( T 2 n ) is very small. 

Still, after some time, longer than T™, the server M 2 will equilibrate, and 
its state /4 will go to its (weak) limit, v 2 2 , which is the invariant state of A2, 
with p 2 = N (/4) = N (is?) = N (i/ A J . 

Let the finite rectangle I 2 C f2[ 0j c 2 -i] be the smallest one on which "almost 
all of the measure v 2 2 is concentrated" , in the sense of relation (fTT?|) . Define 
the time T| n as the first moment t after T™, at which the state fx\ is e-close 

to v 2 2 . Due to the continuity of the dependence of the restriction /x T on 

h 

B, A we can claim the existence of the values S3 < 00 and d 2 < 1 — d\, such 
that for all B-s and A-s with B 3 > B 3 and 1 — d% > d 2 > d 2 the state // of all 
corresponding servers M (B, A) at the moment * = T 2 6n are 2^-close to v? ■ 

The choice for d 2 is the value d 2 . Since d\ + d 2 < 1, after some long time 
t > Tf n there will be almost no clients on the level below C 2 - namely, we 
will have that Nq [0 c j (//) < £ and As 5 a (t) < s - provided only that the 
value B 3 is big enough for the rate Xb,a (t) to have time to "almost" vanish. 
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(The claim that iV«, 0(7 ^ (//) < e, being valid, is not used in our argument, 
so we will omit its proof.) This statement is proven in precisely the same 
way as in the previous section, using again the Lemma El So let T 2 m > T| n 
be the first such t, like in the previous section. 



4.3 The end of the proof 

Clearly, the above construction can be iterated. The result of infinite num- 
ber of its iterations is the needed server M (B, A) . The only think to be 
established is the relation (fH2|) , together with the positivity of the constant 
cpk (?7, p) there. 

As was explained earlier, the values of the limiting rate function A^a if) 
at the moments t = T k n , k = 1,2,.. are very close to the limiting values 
Afe = A g Afe ) which are input (=output) rates of the corresponding approxi- 
mating servers Af (^B k , A& j , as they approach their stationary states. These 
limiting rates can be found from the relation, easily obtained by combina- 
tion of Little's formula and Pollaczek-Khinchin formula for M GI l,oo 
queuing system: 

Pk 2(l-A fc E( % ))' 
see e.g. jSt], sect. 5.0. Here % is the random service time of the server 
Af (Bk-, A fc j , and pt is the average number of clients in it. Solving that 
equation for A^ we find 



y (E ( % ) Pk y + 2 Pk E (rjl) - E ( Vk ) p k 

By our construction the quantities p k , E (77^.) , E {rjl) all go to their limits as 
k — > 00, which are finite and positive. So the limit 



, E( Vk )p k ) 2 + 2p k E( V l)-E(r ]k )p k 
c PK (rj, p) = Km ^ 

is positive as well. 
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5 Appendix I. Weak PH for discrete service 
times 



In this section we will extend the results of |KRj , concerning the Weak Pois- 
son Hypothesis for the networks on complete graphs, to the situation when 
the service time is integer valued. The WPH deals with the following situa- 
tion, described already in the introduction. There are N customers, under- 
going service by M servers. The customers are served on the basis of the 
First-In-First-Out (FIFO) protocol. Before being served they might wait in 
queues. The service times at different servers are i.i.d. random variables, 
with the distribution 77. After being served the customer chooses randomly 
one of M servers, with probability pjj- each, and goes for service to it. So 
customers never leave the network, nor are there new customers arrivals into 
it. This model is suitable for describing real situations when each client visits 
many servers before exiting the network. 

Once we specify the initial state of the network, its (random) evolution 
is defined. In fact, it is Markov process on the set CIm of configurations of 
our network, if by configuration the following is meant: 

• at every node we need to know the length n of the queue, n — 0, 1, 2, 

• if n > 1 - that is, the server is occupied by some client - we need to 
know the time r the server already spent working on that client. 

A state of the network is therefore a probability measure v on Vlj^ — f2 

If M, N are large, the above Markov process becomes quite complicated, 
and in order to make it treatable one has to go to the limit M,N — > 00. 
So let us fix sequences M — ► 00, N — ► 00, such that |r — > p, and suppose 
that for every M we are given some initial state i>m on Qm- To have the 
convergence we are looking for, we need of course to impose some conditions 
on the sequence vm- We will need the following properties. 

• Symmetry. The permutation group Sm acts on VLm in a natural way. 
We want the measures vu to be S^-invariant. 

• Convergence (LLN). There is a projection map II from the set VLm 
to the set of probability measures M. (Q) on Q, which to every point 
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uj m = (loi, ...,ojm) € VL M corresponds the measure 

1 M 

t=l 

Therefore the induced map II : M (Vt M ) — > -M (.M (fi)) is defined. So 
we have a sequence II (vm) °f the elements of the set M. (M. (0)) . We 
need that the week limit limll (Pjy) exists, and moreover it is not just 
some element of M. (M. (ft)) , but is atomic, i.e. belongs to the image of 
the natural inclusion of M. (ft) in A4 (M. (ft)) . Namely, this inclusion 
assigns to every measure v on Q the measure 5 U on M. (ft) . So we need 
that 

]imIL(D M ) = 6 v (22) 

for some v. In other words, we need the Law of Large Numbers to hold 
for the sequence IT (v M ) ■ 

Theorem 3 Let Jj^ m be the state of the above defined Markov process on Qm 
at the time t, with symmetric initial state pP M = 9m . Let us denote by fi M \ K 
its restriction to Qk- 

Suppose that (JUJ) holds. Then for every K > 1 the limiting projection 
fioo^ = li m M^oo P?m\k s ptit s a product of K independent identical pro- 
cesses, //, which are NMP-s with initial state /i° = v. (For rj taking integer 
values the process // is defined in the Section 2.) 

For continuous service time 77 the corresponding process // is described 
in details in jKRj or |RS| . 

In the continuous case the proof of the above theorem is the subject of 
the paper |KRj and is quite involved. The idea is to study the generators Am 
of the processes p,* M and to consider their limit, A. Then one has to build the 
process corresponding to A and to use the Trotter-Kurtz Theorem, which 
gives conditions of convergence of Markov processes to the limiting process 
in terms of convergence of the generators. 

In the discrete case the situation is much simpler. 

We begin with a simple lemma. 

Lemma 4 Let the measures T>m satisfy the symmetry condition. Then the 
convergence condition is equivalent to the Propagation of Chaos property: for 
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every K > 1 

lim i>m\k = v x ••• x v < (23) 

In fact, it is sufficient to consider only the K = 2 case. 

Proof. By de Finetti theorem we know that the limit measures hin^^oo vm\k 
is either a product measure, like in , or a mixture of such products, 
J k x ... x x d (dx) , where the measure d G M. (A4 (O)) is non-atomic and 

K 

does not depend on K. But in the latter case we have that hin^^oo n (pm) — 
d. 

Conversely, if the limit limM^oo n (%) = is non-atomic, then the two 
components of the measure Vm\k=% are dependent even in the limit M — > oo. 
■ 

Proof of the Theorem 3. Our proof goes by induction in t. Clearly, we 
will be done once we prove the statement of our theorem for just one value 
of time, t — 1. 

Let us first investigate the total flow Em of the customers from all the 
M servers after the first step. If we condition on the initial configuration 
uj m = (u)\ = (ni,Ti) , ■■■,u)m = (jimiTm)) £ Rm> then the total flow is given 



by the sum S 



M 



variables distributed as follows: 



um = 0i + ... + a Mi where a, are independent random 



1 with probability p n , 
with probability 1 — p n , 



see (J2J) • The unconditional flow is then given by 



We need first to establish the Law of Large Numbers for the sequence Em- To 
that end let us denote by C T (ujm) the number of indexes i G {1,2, M} , 
for which r, = r. Then 



oo C T {ijJm ) 

^ m = 5Z a J' 

r=l j = l 
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where {erj : j,T — 1,2, ...} are independent random variables, and for every 
fixed r {aj : j = 1,2, ...} are i.i.d., with 



cr„- 



1 with probability p T , 



J | with probability 1 — p T . 

Clearly, LLN holds for S M once it holds for random variables C T (com) , which 
distribution is governed by the measures 9m- But the convergence in proba- 
bility Ct m m ^ — > v (n, r) follows immediately from LLN for the sequence 

By symmetry, the average flow to any given server and from any given 
server in the state Ji M are the same. So we need only to check that the flow 
to any given server is asymptotically Poisson, and that the flows to any two 
given servers are asymptotically independent. 

The number of customers n M , going to a given - say, first - server, is 
given by 



s 



A I 



where the random variables £j are i.i.d., 

1 with probability ^, ^ 
with probability 1 — ^ ' 

The meaning of the event & = 1 is that the z-th customer, % — 1, ...,E M , 
decides to go to the first server for the next service. But since the random 
variable S A f satisfies LLN with the mean value ~ M - in fact, 

E(E M ) 



M 



p T dv 



- the distribution of n M is asymptotically Poisson, due to the Poisson limit 
theorem. 

The flow of customers (nf^n^) , going to the first two servers, is the 
random vector 



= 1 



where 



(1,0) with probability jg, 
(1,0) with probability 
(0, 0) with probability 1 — 



_2_ 
M ' 
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Clearly, the random variables ,nif are not independent. They are, how- 
ever, independent asymptotically, when M — > oo. To see it, consider the 
conditional distribution of nf 1 under condition that = k. We have 



n 2 



t=i 



with £j being given by 

6 = 



with probability 



with probability — 



31) 

M 



so Poisson limit theorem still applies. But since for every 



M 



lim , . x 

M ^ (i - if) 



(E (E M ) - fc) = lim V7E(S M ; 



the conditional distribution nf 



converges to that of nf f . This con 



vergence is of course not uniform in k, but since the tail of the Poisson 
distribution decays exponential, it is immaterial. ■ 



6 Appendix II. Full PH for discrete service 
times 

As is explained in [RSJ, we have to consider the following random processes, 
associated with a single server: given any function A (t) > 0, t — 0, 1,2, 
we consider the corresponding integer Poisson process of arriving customers. 
It is defined in the standard way: the probability that n customers arrive at 
a given moment t G N is given by 

n\ 

while the arrivals at different moments are independent. The customers are 
served in the order they come, and the service times are given by the inde- 
pendent realizations of a random variable rj, which in our case will take only 
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finitely many integer values. We suppose that the (finite) support & (rj) C N 
of the distribution function p of rj contains the value 1 e N, i.e. p (1) > 0. In 
particular, the case of rj = 1, considered earlier by Stolyar, see |S|, is included. 
We denote by T the maximal element in (5 (rj) , and we put E — E (rj) . 

A configuration on the server at a given time moment t consists of the 
number n > of customers waiting to be served plus the duration r of the 
elapsed service time of the customer under the service at the moment t. The 
set of configurations Q is thus the set of all pairs (n, r) , with integers n > 
and t G [0,T — 1], plus the point 0, describing the situation of the server 
being idle. For a configuration uj = (n, r) G Q we define N (u) = n. We put 
iV (0) = 0. A state of the server is any probability measure on Q. 

Once the initial state v and the rate function A (t) are given, the evolving 
state /U^a (t) is defined, \jl v ^\ (0) = u, which constitutes a non-homogeneous 
Markov process - General Flow Process (GFP) in terminology of |RSj . In 
particular, the exit flow of customers whose service is over, is defined. Let 
b (t) be the mean number of the customers exiting the server at the moment 
t. The function b is uniquely defined by the function A and initial state v\ 
therefore we can write that b (■) = A (u, A (■)) , where A is the corresponding 
operator. 

For constant A = c the process becomes homogeneous, and we have the 
weak convergence ^\ (t) — ► v c as t — * oo, for any initial state v. 

The Non-Linear Markov Process (NMP) is a special case of GFP, which 
corresponds to the function X u , satisfying the fix-point equation 

\„(.) = A{u,\„(-)). 

The above notation suggests that for every initial state v the corresponding 
NMP exists and is unique; this is indeed the case, see |RSj and |KRj . 

As in |RSj . the validity of the Poisson Hypothesis in our setting holds 
once the following is proven: 

Theorem 5 For every initial state v with finite mean queue: 

N(u) = E v (N(co)) < oo, 
the solution \ u (■) of the equation 

A(i/,A(.)) = A(.) 



20 



has the relaxation property: 



X u (t) — > c as t — > oo, 
where the constant c satisfies for every t the relation 

N (*)) = E^ (t) (N (u)) = N (u c ) = E Uc (N (u)) . 
Moreover, fJ, u ,x v (-) (t) — > v c weakly, as t — ► oo. 

In the following we are indicating the changes in the proof of the main 
result of |RSj - Theorem 1 - needed in order to extend it to the case treated 
by the above theorem. Here and later we will use italics to indicate the 
statements in [RSJ. 

The first statements - from Theorem 3 to Theorem 6 - remain unchanged. 
In particular, we have the validity of the key self-averaging relation: 

b (x) = [A * q x , x ) (x) 

for some probability kernels q\ yX ; the only difference now is that all the mea- 
sures g*,* have integer supports. To see that the proofs of these statements 
can be extended to cover the new setting, one can argue as follows: let us ap- 
proximate weakly our (atomic) rate measure XlneN ^ ( n ) by the continuous 
rate measure A £ (t) dt, where 

^ if|t-n|<e, 
otherwice. 

We can also approximate weakly the discrete probability distribution p (n) 
by a density p e (t) > 0. The results of Theorems 3-6 are applicable to the 
^-approximations. Since the statements are just identities, we can pass then 
to the limit e —>■ 0. 

Let us go to Lemma 7, which is based on Proposition 8, which in turn 
follows from Lemmas 11 & 12. The statement of Lemma 7 - relation (55) - 
should now read: 

f>(t) <T{E-s>): 

t=s 

the integral is replaced by the sum, while instead of 1 we need to use E - 
the mean value of rj (the mean one assumption is no loss of generality for 
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the real valued random variables, but not for integer valued ones!). Lemma 
11 deals with the Poisson flows with continuous rate functions A (t) . Two 
proofs of that lemma are given in |RSj . and the second one is using the 
discrete approximations, followed by the limit procedure. But the discrete 
approximation step itself gives the proof of the modified statement we need, 
applicable to integer Poisson process of customer arrivals. 

The following statement is the replacement of Lemma 12; though the 
changes are infinitesimal, we present here this discrete counterpart of this 
lemma, in order to dispel even the slightest problems the reader might have. 

In what follows we denote by K^ a ' the measure on [A,B] CR 1 , having the 
constant density A (t) = a. We denote by «w the atomic measure counterpart 
on [A, B] CN : for any integer t G [A, B\ , (t) = a. 

Lemma 6 Let the atomic measure x on [ A, B] = {A, A + 1, ...,B} C N is 
bounded, < \ it) < L for every t G [A, B] , and satisfies the property: 

X([A,B)) > (E-b) (B + l-A). 

Then there exists a segment [A, C] C [A, B] of the length 

C + 1-A>y (B + l-A), (25) 
lj 



such that 

X 



[A,C] 



[A+l.C-l] 



Proof. Let us fix some number M > 2, and consider the measure \ M on 
[A - \, B + |] cM 1 , defined by the density 

yM ^ _ / Mx (n) if \t — n\ < ^ for some integer n G [A, B] 



otherwice. 

Let us smooth the function X M (t) by a small perturbation; the smoothed 
version of it still will be denoted by A A/ (t) . We have that the measure x M on 
[A-\,B + \] satisfies X M ( [A - |, B + \] ) > (E - e) (B + \ - (A - |)) , 
while < X M (t) < ML. We can well repeat for the measure x M the steps of 
the proof of Lemma 12. As there, we consider the disjoint maximal segments 
[Ci, D x ] , [C 2 , D 2 ] , ... C [A - |, B + |] of the family of all segments [c, d] C 
[A — |, B + , for which we have the property 



x M 



(26) 
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and denote by [A — ~, a] the segment [Q, Dj\ among these maximal, which 
contains the point A — ~. For all the segments [C k ,D k ] except [A — ~,a] , 
we again have 

X M ([Ck,D k ]) = (E-2s)(D k -C k ), (27) 

while for any point x £ [A — |, B + |] outside all of the segments [Cj, Z?j] , 
we have X M (x) < E — 2s. Together with (J2TJ) it implies that 



X 



M 



(28) 



On the other hand, 



X" 



M 



A--,B + - 
2' 2 



Ai 



A , a 

2' 



+ X 



a, 5 + - 



(29) 



> (£ - e) (B + 1 - A) . 



Therefore the segment [A — |,a] is non-trivial. By definition (f2T)j) we have 
that \ M (a) > E — 2e. From the maximality of the segment [A — |,a] 
it then follows that a = m + ^ for some integer m G [A, B] . Clearly, 
X M ( [ A ~ h m + m\ ) < L(m+1 — A) , while 02EJ reads 



A4 



1 „ 1 

m + 1 ,.B+ - 

2M' 2 



< 2e) ( 5 + - - (m + 1 ' 



2M 



Together with (|29jl it implies that 



m + l- A>-(S + l-A). 



(30) 



So we have 



Ai 



y k^ e - 2 ^ 



[ A -h m +2w] 
Comparison with the atomic counterpart 



(E-2e) 



l A -h m +wi 



,y k 



(E-2e) 



[A+l.m-l] 



gives us the relation 



X 



M 



y 



[A+l,m-l] 
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Since it holds for every M, we conclude that 



X 



>- R 



(E-2e) 



[A,m] 



[A+l,m-l] 



From (|3()|) the proof now follows. ■ 

Lemma 13 remains unchanged. Lemma 14, stating the Lipschitz property 
of the function A, cannot be valid, of course, in our case. In fact, in the 
discrete case no analog of Lipschitz property is needed, as we will explain 
later. 

To get the counterpart to the Lemma 15, which provides a lower bound 
for the kernels q*^, we first establish a lower bound on the rates A^ (t) of the 
NMP-s, t E N. 

Lemma 7 Let v be any initial state, i.e. a probability measure on Q, and let 
fJ'VtXvt-) (t) be the corresponding non-linear Markov process. Then there exist 
a time duration T and a constant c > 0, both depending only on rj, such that 



Proof. The statement is almost evident. For example, the value T = 
max {A; :fce6 (77)} will go. Indeed, during any T consecutive time moments 
t + l,t + 2, ...,t + T there has to be at least one, t°, at which the mean exit 
number of customers - i.e. the value A (to) - is at least h. The next such 
moment t 1 will happen not later than t°+ T. But at the moment to the 
average number of arriving customers is also A (to) , and since each of them 
has a positive probability p (1) of finishing his service in the unit time, all 
the values \ (t + 1) , \ (t + 2) , \ (t + T) are bounded from below by a 
constant c, depending only on T and p (1) . ■ 

The replacement to Lemma 15 can now be presented. 

Lemma 8 Let the function A satisfies 



X u (t) > c provided t > T. 



C> A > c> 0. 



(31) 



Then 



c 



,t-i 



Qx,y (t) — P r {server is idle at the moment y — t} e 



-c 



P (iy. (32) 



(f-1)! 



24 



For the case of NMP the condition holds, according to Lemma [7| 
Proof. The relation (|32j) follows easily from the definition, see relations (27), 
(28) in [RSJ. We already have a lower estimate for the first factor. Let us 
consider the second one, i.e. the conditional probability 



the server is never idle during 
Pr ^ [u, u + 1] ; at u + 1 

some client leaves the server 



the server is idle 
just before u, 
at u a client arrives 



Clearly, the event needed will happen, if at moment u at least t — 1 more 
clients will arrive, while the first t clients will have their service time equal to 
1. The probability of the former event is The probability of arriving 

t — 1 extra customers is at least 



„t-i 

.n ' 

e 



-c c 



(t-iy: 
■ 

Lemmas 16-18 and Theorem 19 do not need any alterations. 
Next ingredient needed for the proof of Theorem 1 - or our Theorem El - 
is Lemma 23. Its discrete analog states in particular that if the equation 

X 

f(x)=^2f{x-y)q x {y) (33) 

holds, then under certain assumptions on the probability kernels q the func- 
tion / has to flatten out: 

Let M = lim sup^^ / (x) . Then for every T and every e given there 
exists some value K\, such that 

min f (x) > M — e. (34) 

The properties of q needed were: 

• compactness (99): for every e > there exists a value K (e) , such that 

K{e) 

(y) ^ 1 " e ( 35 ) 



uniformly in x; 
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• lower bound (100): for every T the quantity 

Ft = inf inf q x (y) 

x>X(T)ye{l,2,...,T} 

is positive for some choice of the function X (T) < oo; 

• the solution / of (|33|) is bounded from above, / < C, and has Lipschitz 
property. 

We have already commented on the validity of the first two in our case; 
the Lipschitz property will not be needed, as we are going to show now. 

Proof of . Let 8 > 0. Then there exists a value S = S (5) > 0, 
such that for all x > S we have / (x) < M + 5. Further, there exists a value 
R = R(8) > S, such that for all y > R 

oo 
x=R-S 

see Finally, there exists a point y = y (5) > R + T, such that / (y) > 

M — 5. Due to the equation (}3"3"j) we have for this point 

y—S oo 

f(y) = Y,f(y- t )iy( t )+ E f(y-t)g v (t). 

t=0 t=y-S+l 

Let A = {x G [y — T, y\ : / (x) < M — e} , while a = J2teA % (0 ■ ^ e wan t 
to show that a has to be small for small 5. Splitting the first sum into two, 
according to whether the point y — t is inside A or outside, we have 

M - 5 < a (M - e) + (1 - a) (M + 5) + C6, 

which implies that 

(2 + C)5 
a < -— . 

£ + 5 

The last ratio goes to zero with 5 for every fixed e. In particular, we can 
choose 8 — 8 (e) so small that < Ft- That however is consistent with 

the definition of Ft only if A = 0. ■ 

The rest of the statements of |RSj . needed to obtain the proof of Theorem 
does not need any modifications. The only exception is the statement of 
Lemma 31, where one has to replace the bound c (u) < 1 by c (z/) < E. 
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